Grid-Brick Event Processing Framework in GEPS
نویسندگان
چکیده
Experiments like ATLAS at LHC involve a scale of computing and data management that greatly exceeds the capability of existing systems, making it necessary to resort to Grid-based Parallel Event Processing Systems (GEPS). Traditional Grid systems concentrate the data in central data servers which have to be accessed by many nodes each time an analysis or processing job starts. These systems require very powerful central data servers and make little use of the distributed disk space that is available in commodity computers. The Grid-Brick system, which is described in this paper, follows a different approach. The data storage is split among all grid nodes having each one a piece of the whole information. Users submit queries and the system will distribute the tasks through all the nodes and retrieve the result, merging them together in the Job Submit Server. The main advantage of using this system is the huge scalability it provides, while its biggest disadvantage appears in the case of failure of one of the nodes. A workaround for this problem involves data replication or backup.
منابع مشابه
Enabling Queries Using the Grid-brick Approach: A Distributed Data Storage Architecture
This paper presents a Grid-based parallel Event Processing System (GEPS) that is applicable to all the domains where large collections of separate blocks of data (images) need to be processed, stored and analyzed. Data intensive applications are becoming increasingly important in many science areas. In many domains the need for future computing and data management capabilities is difficult to a...
متن کاملA Distributed Data Storage Architecture for Event Processing by Using the Globus Grid Toolkit
In this paper we discuss a Grid-based Event Processing System (GEPS). Data intensive problems broadly exist in many scientific computational areas; usually their needs for super storage and computing capacities are difficult to be fully satisfied. Meanwhile the Globus Toolkit has become the de facto standard of building high performance distributed computing environments. Event processing and f...
متن کاملMultitask Generalized Eigenvalue Program
We present a novel multitask learning framework called multitask generalized eigenvalue program (MTGEP), which jointly solves multiple related generalized eigenvalue problems (GEPs). This framework is quite general and can be applied to many eigenvalue problems in machine learning and pattern recognition, ranging from supervised learning to unsupervised learning, such as principal component ana...
متن کاملV-Grid-A Versioning Services Framework for the Grid
A large variety of emerging Computational Grid applications require versioning services to support effective management of constantly changing datasets and implementations of data processing transformations. This paper presents V-Grid, a framework for generating Grid Data Services with versioning support from UML models that contain structural description for the datasets and schema tuning info...
متن کاملThe Role of Event Related Potentials in Pre-Comprehension Processing of Consumers to Marketing Logos
Background: In human behavior study, by peering directly into the brain and assessing distinct patterns, evoked neurons and neuron spike can be more understandable by taking advantages of accurate brain analysis. Objectives: We investigated the role of Event Related Potentials (ERPs) in pre-comprehension processing of consumers to marketing logos.. Materials & Methods: In the framework of an ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره cs.DC/0306093 شماره
صفحات -
تاریخ انتشار 2003